Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation

Convolutional neural networks have been widely deployed in various application scenarios. In order to extend the applications' boundaries to some accuracy-crucial domains, researchers have been investigating approaches to boost accuracy through either deeper or wider network structures, which brings with them the exponential increment of the computational and storage cost, delaying the responding time. In this paper, we propose a general training framework named self distillation, which notably enhances the performance (accuracy) of convolutional neural networks through shrinking the size of the network rather than aggrandizing it. Different from traditional knowledge distillation - a knowledge transformation methodology among networks, which forces student neural networks to approximate the softmax layer outputs of pre-trained teacher neural networks, the proposed self distillation framework distills knowledge within network itself. The networks are firstly divided into several sections. Then the knowledge in the deeper portion of the networks is squeezed into the shallow ones. Experiments further prove the generalization of the proposed self distillation framework: enhancement of accuracy at average level is 2.65%, varying from 0.61% in ResNeXt as minimum to 4.07% in VGG19 as maximum. In addition, it can also provide flexibility of depth-wise scalable inference on resource-limited edge devices.Our codes will be released on github soon.Comment: 10page

Refractive elastic scattering of carbon and oxygen nuclei: The mean field analysis and Airy structures

The experimental data on the $^{16}$O$+^{12}$C and $^{18}$O$+^{12}$C elastic scatterings and their optical model analysis are presented. Detailed and complete elastic angular distributions have been measured at the Strasbourg Vivitron accelerator at several energies covering the energy range between 5 and 10 MeV per nucleon. The elastic scattering angular distributions show the usual diffraction pattern and also, at larger angles, refractive effects in the form of nuclear rainbow and associated Airy structures. The optical model analysis unambiguously shows the evolution of the refractive scattering pattern. The observed structure, namely the Airy minima, can be consistently described by a nucleus-nucleus potential with a deep real part and a weakly absorptive imaginary part. The difference in absorption in the two systems is explained by an increased imaginary (mostly surface) part of the potential in the $^{18}$O$+^{12}$C system. The relation between the obtained potentials and those reported for the symmetrical $^{16}$O$+^{16}$O and $^{12}$C$+^{12}$C systems is drawn.Comment: 10 pages, 9 figures, Phys. rev. C in pres

International Asteroid Warning Network Timing Campaign : 2019 XS

Peer reviewe

DNA methylation and body mass index from birth to adolescence : meta-analyses of epigenome-wide association studies

Background DNA methylation has been shown to be associated with adiposity in adulthood. However, whether similar DNA methylation patterns are associated with childhood and adolescent body mass index (BMI) is largely unknown. More insight into this relationship at younger ages may have implications for future prevention of obesity and its related traits. Methods We examined whether DNA methylation in cord blood and whole blood in childhood and adolescence was associated with BMI in the age range from 2 to 18 years using both cross-sectional and longitudinal models. We performed meta-analyses of epigenome-wide association studies including up to 4133 children from 23 studies. We examined the overlap of findings reported in previous studies in children and adults with those in our analyses and calculated enrichment. Results DNA methylation at three CpGs (cg05937453, cg25212453, and cg10040131), each in a different age range, was associated with BMI at Bonferroni significance, P <1.06 x 10(-7), with a 0.96 standard deviation score (SDS) (standard error (SE) 0.17), 0.32 SDS (SE 0.06), and 0.32 BMI SDS (SE 0.06) higher BMI per 10% increase in methylation, respectively. DNA methylation at nine additional CpGs in the cross-sectional childhood model was associated with BMI at false discovery rate significance. The strength of the associations of DNA methylation at the 187 CpGs previously identified to be associated with adult BMI, increased with advancing age across childhood and adolescence in our analyses. In addition, correlation coefficients between effect estimates for those CpGs in adults and in children and adolescents also increased. Among the top findings for each age range, we observed increasing enrichment for the CpGs that were previously identified in adults (birth P-enrichment = 1; childhood P-enrichment = 2.00 x 10(-4); adolescence P-enrichment = 2.10 x 10(-7)). Conclusions There were only minimal associations of DNA methylation with childhood and adolescent BMI. With the advancing age of the participants across childhood and adolescence, we observed increasing overlap with altered DNA methylation loci reported in association with adult BMI. These findings may be compatible with the hypothesis that DNA methylation differences are mostly a consequence rather than a cause of obesity.Peer reviewe

Unprecedented random lasing in 2D organolead halide single-crystalline perovskite microrods

Three-dimensional organic–inorganic hybrid halide perovskites have been demonstrated as great materials for applications in optoelectronics and photonics. However, their inherent instabilities in the presence of moisture, light, and heat may hinder their commercialization. Alternatively, emerging two-dimensional (2D) organic–inorganic hybrid perovskites have recently attracted increasing attention owing to their great environmental stability and inherent natural quantum-well structure. In this work, we have synthesized a high-quality long-chain organic diammonium spacer assisted 2D hybrid perovskite FA-(N-MPDA)PbBr4 (FA = formamidinium and N-MPDA = N-methylpropane-1,3-diammonium) by the slow evaporation at constant temperature method. The millimeter-sized single-crystalline microrods demonstrate low threshold random lasing behavior at room temperature. The single-crystalline 2D hybrid perovskite random laser achieved a very narrow linewidth (∼0.1 nm) with a low threshold (∼0.5 μJ cm−2) and a high quality factor (∼5350). Furthermore, the 2D hybrid microrod laser shows stable lasing emission with no measurable degradation after at least 2 h under continuous illumination, which substantially proves the stability of 2D perovskites. Our results demonstrate the promise of 2D organic–inorganic microrod-shaped perovskites and provide an important step toward the realization of high-performance optoelectronic devices

DNA methylation and body mass index from birth to adolescence: meta-analyses of epigenome-wide association studies

Background DNA methylation has been shown to be associated with adiposity in adulthood. However, whether similar DNA methylation patterns are associated with childhood and adolescent body mass index (BMI) is largely unknown. More insight into this relationship at younger ages may have implications for future prevention of obesity and its related traits. Methods We examined whether DNA methylation in cord blood and whole blood in childhood and adolescence was associated with BMI in the age range from 2 to 18 years using both cross-sectional and longitudinal models. We performed meta-analyses of epigenome-wide association studies including up to 4133 children from 23 studies. We examined the overlap of findings reported in previous studies in children and adults with those in our analyses and calculated enrichment. Results DNA methylation at three CpGs (cg05937453, cg25212453, and cg10040131), each in a different age range, was associated with BMI at Bonferroni significance, P < 1.06 x 10(-7), with a 0.96 standard deviation score (SDS) (standard error (SE) 0.17), 0.32 SDS (SE 0.06), and 0.32 BMI SDS (SE 0.06) higher BMI per 10% increase in methylation, respectively. DNA methylation at nine additional CpGs in the cross-sectional childhood model was associated with BMI at false discovery rate significance. The strength of the associations of DNA methylation at the 187 CpGs previously identified to be associated with adult BMI, increased with advancing age across childhood and adolescence in our analyses. In addition, correlation coefficients between effect estimates for those CpGs in adults and in children and adolescents also increased. Among the top findings for each age range, we observed increasing enrichment for the CpGs that were previously identified in adults (birth P-enrichment = 1; childhood P-enrichment = 2.00 x 10(-4); adolescence P-enrichment = 2.10 x 10(-7)). Conclusions There were only minimal associations of DNA methylation with childhood and adolescent BMI. With the advancing age of the participants across childhood and adolescence, we observed increasing overlap with altered DNA methylation loci reported in association with adult BMI. These findings may be compatible with the hypothesis that DNA methylation differences are mostly a consequence rather than a cause of obesity

Short review of nonplanar fused deposition modeling printing

As one of the additive manufacturing (AM) methods, fused deposition modeling (FDM) technology is widely adopted but involves some limitations in lacking surface quality and mechanical properties due to the use of only planar layers. This review will explore the novel FDM approach, curved layer FDM (CLFDM) where a nonplanar slicing technique is introduced to improve on these shortcomings. Recently, this technique has gained more and more traction in the industry and among consumers owing to not only its great potential to overcome several manufacturing limitations of conventional FDM method such as the “staircase effect” and poor bonding strength of curved surfaces or shells but also enhanced mechanical properties of CLFDM printed parts. The present review mainly focuses on the toolpath generation, process adaptations, mechanical properties of the printed part, and novel applications in the CLFDM method

Selective Search Collaborative Representation for Hyperspectral Anomaly Detection

As an important tool in hyperspectral anomaly detection, collaborative representation detection (CRD) has attracted significant attention in recent years. However, the lack of global feature utilization, the contamination of the background dictionary, and the dependence on the sizes of the dual-window lead to instability of anomaly detection performance of CRD, making it difficult to apply in practice. To address these issues, a selective search collaborative representation detector is proposed. The selective search is based on global information and spectral similarity to realize the flexible fusion of adjacent homogeneous pixels. According to the homogeneous segmentation, the pixels with low background probability can be removed from the local background dictionary in CRD to achieve the purification of the local background and the improvement of detection performance, even under inappropriate dual-window sizes. Three real hyperspectral images are introduced to verify the feasibility and effectiveness of the proposed method. The detection performance is depicted by intuitive detection images, receiver operating characteristic curves, and area under curve values, as well as by running time. Comparison with CRD proves that the proposed method can effectively improve the anomaly detection accuracy of CRD and reduce the dependence of anomaly detection performance on the sizes of the dual-window